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A System for Processing and Decoding MPEG Compatible 
Data and Internet Information 

This is a non-provisional application of provisional 
C C "°9 n 7. Serial 60/ ° 43 ' 539 ^ * J - L °^ n « * " 

Field of the Invention 

This invention is related to the field of digital signal 

TmPEg' ^ ^r/^^ 13 ^ t0 the -d ^coding 

of MPEG compatible data and Internet information. 

Background of the Invention 

15 Home entertainment systems which combine Personal 

Computer and television "functions (PC/TV systems) are 
incrcasmgly becoming, generic, User interactive, multiple source 
and mulnple destination communication devices. Such systems are 
^ required to communicate in different data formats between 
2 0 multiple locations for a variety of applications in response to User 
requests. For example, a PC/TV system may receive data from 

Tetv ° r H n^ eStrial S ° UrCCS Com P» si *S High Definition 
" ™ evislon (HDTV) broadcasts, -Mult^oir^ Microwave DisBbutio^ 
7 , I** 1 ™ (MMDS) broad ^s <*nd Broadcasts (DVB). A 

25 PC/TV^ system may also, receive ,an4, .transmit data via- telephone- 
(e.g. the Internet) and coaxial, lines (e.g. cable TO and from both 
remote and Ideal sources su^ as Digital Video Disjc <DVjb), CDROM 
VHS and Digital VHS (DVHS™) |y P e players, PCs, anel many ^ 
types of sources. •., ... -. ';: 

3 0 .... A number of problems arise in developing such a 
generic PC/TV entertainment;, system. Specifically problems arise >" 
m supporting , communication; between multiple . data sources and 
in processing-data from the ;JnuItiple sources. A^roWem is also 
presented by the need to devise a-User interface & such a system . . 

3 5 that supports complex Use* interactive tasks; whilst providing a ^ 
simple command interface; , ^itab^e for the general , public. A 
PC/TV system User interface; : ^r example, should allow a User to 
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view a selected program and permit User operation of functions 
such as Email, telephone, Internet access, fax and video-phone 
functions. Such applications require communication between a 
PC/TV unit and a variety of both remote sources e.g. a satellite 
5 service provider, and local sources e.g. a DVD storage device. 
Further, a PC/TV needs to process and decode data in different 
data formats from -different devices and display received data to 
the LJser. These problems are addressed by - a system according to 
the present - inventicmu T - ^ : \: ~, ; - :or; - 

i6 : " - " •• ■ 

Summary of the Invention 

The inventors have, thereby recognized that a Program 
Guide type of User interface advantageously provides a simple, 

1 5 ^ easy , to. , use , interface r f or> i Usm toperatioik ©f functions- Isuch as Email, 

telephone^ t) Jj|tej^e$ r . ae^es^-if ax-, rrhome 'cr<Jtftrbl£ -1 and* videb-pKbne 
functions. The use of a Program Guide ;fbr sucli- vfMctions also 
advantageously provides a single User interface for User operation 

s pf multiple, ■ devices; and associated l functions. ^ ; 0 i 
20 ^ _ Thev inventors- -have'. -further recognized ' that- it is 

i desirable f or r a video- decider . sy sterii to " be capable ' a of decoding 
input yidep : , data encoded in i& * 'plurality^ -of 7 encoding ^formats such 
as MPEG compatible and Internet compatible data c formats. 
Further, that it is desirable for a decoder to be capable of 

2 5 displaymg^ the decoded ^data^r derived: from the different encoding 

formats e.g. decoded MPEG: video ^program data and web page 
Internet data as a ^composite video image: : : - t : ; : . 

A video decoder system decodes input video data 
i^coded r in; a .plurality. -p/: enaodingTlform^ts." The -decoder includes a 

3 0 jfiret, processor for; decoding MPEG .compatible data identified by a 

first , data identifier to provide r first decoded videb output. The 
decoder also includes a second processor for decoding data 
encoded in an Internet compatible data format identified by a 
.second data - identifier td^ provide. ?a ^second decoded : video output. A 
3 5 .display -processor rfprmats, !thet fitst Oand F second 7 ^ 
.outputs for display at§; a composite video image ^ 
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of : the video image contributed by the first • and second decoded 
outputs is variable. - •:. 

^ Br ief Description of the Drawings 

In the drawing: ^ : _ :? > r- ^ 

Figure . l t shows a home entertainment d'ecbder system, 
according to. the i.nven^dn,'>for^eoMmuliibatinI' Wi'th'^a plurality of 
sources and for processing program guW information and 
10 program content data. 



Figure 2 shows an exemplary Program Guide display 
format acc|pfdii^ v tOr.$hieuiiyi»d6n^^d :-i or~ivn: aril' 
; -:v. rssbbci; ^ki'C^£.-itsvb.-, ';os't-..3»ai "to- *qyj &.o.t 

;-.^Fi«UTejr:3l; sho^si: ~a ^*Ia?ta? ^format; ^l&coraihg ; to a %e^ 
. . invention, f&r t .packe.ti ? ing Internet * data or >transmis^on 3 ^thnl an 

TlArjr?^ i _ ....... ~. - * 



MPEG compatible datastream. a 



Figure 4 ..-shows a- flowchart/" aG e ^rding ; : tb r the i 'rnvehticm, 
20 for receiving, program gaide; dnformationc including User selection' 
iSP&W* ■ ? nd . ■P,roces ; singi theif, received v Information' Vi to~ forrh a 
program .guide r supporting . iUser ^ sfe^fa^lce'^omn^uhicaifiJn 
.functions./. ; •• u . :r ,. v: :ccn3h-i1 is .is -. v-\ 'i •' X i£ 

25 - : : i #gn?e ,5 shows a flowchartv According to" : the; invention, 
for a, .process to form, q oprogramv guide ;jn ! a -video decocfef r from 
information received from- an plurality Resources/ rt b - - ' 



•• > v . r pgure 6f show? ajzflowcfeart? tfeeora^ng^to the r invention, 
30 fif°5 a P roc ess to automatically acquires *&d ••'collate program = guide 
information ( from a ; plurality; of ..sources^ and WforW a "program 
guide, for display. , 0 



. c . . t -:fi«^c7^sho^o.«?;*lack>^aiidqwhitS -Tepfesen&ifckMr of- an 
35 c e £? m P? ar f c PJo% r Prpgram : .Guide^ display format,: according to- the 
.^YWl??' t;.#q?Ktfi& w ra^-^tioiis-vpemittiag a tJser to collate 
programs by source and color attribute. 
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Figure 8 shows a flowchart, according to the invention, 
for a process to acquire information requested by a video receiver 
User via a selection made from options on" a displayed prograip 
5 guide. 

Figure 9 shows a flowchart, according to the invention, 
for a process to decode inpuf Internet information and 
coriipresSed Video data And to form a composite video output for 

1 0 display^ " ~" r ' ' : ~" . , 

~ ;fU • '' o ' r -'-' J0o W3aile'd Descnpiioh* of ike drawings '-\ 

• ! ""*'Fi^ire*^i' ^owi""a home ' eritertairimenf decoder system, 

1 5 according * to * the in veWiok, for ~ commuriicatihg with jpultjple 
- " soured "'to' ''''"a^qtiirV program" guide information \and program 
: "' : content data.' The "dedoder System . forms ' a 'progrm guide for 
K display from information acquired arid' collated automatically from 
'' multiple source^. A User' may initiate ; Email, telephone, Internet, 

2 0 access, fax and video-phone functions via\_sel?c|ion, of options from 

the' displayed ^ograrri ' "guide. The decoder / sy|tem adaptiyely 
''" decodes a datastream encoded to the MPEG ' standard incorporating 
"compressed program .content data' 1 and. Ihtprnef data 
^'representative of,, for . example, Hypertext Mark-up Language. 

2 5 (HTML): The decoded , data is 'formatted' either as /a composite 

video image or as separate Video images for display'...* . 

v The MPEG2 (Moving Pictures' ^ Expert ;;<&oup)' image 
' encoding standard;'' here&after 'referred to as" the "MPEG standard" 
"' is- comprised of .a system encoding section (ISO/IEC '13818-1, 10th 

3 0 June 1994) and a video 4 encoding" section . (ISO/IEC 13818-2, 20th 
1 January 1995), hereinafter referred to as the "MPEG systems 

standard" and "MPEG video standard" respectively. 

* \ Although the disclosed" system is described' in the 
""""context of a system for : receiving an "MPEG compatible signal, it i| 
3 5? exemplary only, the principles ; of the : 'inyeiitiQn\ m*y\"be applied to 
" " systems " in ' which the types T 6f _ to channels and 

communication 'protocols may vary, "or * to- systems in which the 
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coding type may vary. Such systems may include, for example, 
non-MPEG compatible systems, involving other types of encoded 
datastreams and otjier methods of conveying Program Guide 
information. Further, although the disclosed system is. described as 
5 processing broadcast programs, this is exemplary only. The term 
'program* is used to represent any form of data such as telephone 
messages, computer programs, Internet . data or other 
communications, for example. " 

c ,f n ' overview, in the video, receiver system of Figure 1, 
10a carrier modulated with video data "is received from a broadcast , 
satellite by antenna 10 and processed by unit 15. The' resultant 
digital output a . signal ^ is v demodulated, by demodulator 20 and 
decoded and error corrected by decoder 30. In this exemplary 
embodiment, the, demodulated and decoded output from unit 30 is 
15 in the form of an. MPEG compatible transport' stream containing 
MPEG conipr&secL . video ' : data ; 'and Jlnteraet " date encoded in HTML. 
..Video data ^ enpoded" to the form of a 

_ pacl£eti2ed. T d^tasb^m. ^ JwhichJ "twically^ includes the data content of 
,..Rf n y P/p.g.ram channels '(e.g/ content corresponding to cable 

2 0 television channels ."1-125)^^°^' ; . '~ 

, T 5 he MPEG, .compatible transport stream is provided to" 

v pr °- - S ! sor ™ h * c X ii s ~_„ responsive to commands from remote 

^ control unit 125. Processor , 25 communicates with other data 
[I s° } Mf9 e s 'including , storage device 90 and" either internet data 
server 83 or 'internet connection service 87 (e.g. ; America , On- 
line™). Program guide information is 'acquired and collated 
automatically from the input transport , stream and storage device 
90 arid, , either server 83 or connection .service 87. The acquired 
, . information Jis. merged by processor 25 to form a program guide 

3 0 for display .incorporating selection options allowing a User to. 

initiate Email, ', telephone,' ' Internet .access,., fax "'and. video-phone 
functions among others, for example/ the' program guide for 
display is also formed to include non-displayed . information from 
multiple sources for identifying and assembling individual data 
3 5 packets Aa^ cbMtijtute . '.the? program's^ "that are Selected for tiser. 
. viewing or listening. . This .information is used in recovering the 
. }! .:. content of selected' ' ^rpgrams^^from' multiple sources.. 
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Processor 25 adaptively decompresses the input 
compressed video data and decodes the HTML Internet data to 
provide a formatted composite video image for display on unit 75. 
Processor 25 also provides encoded data outputs for storage on 
5 storage medium 105 via storage device 90, and provides encoded 
data to other devices (not shown to simplify drawing) via modem 
80 and telephone lines. f 

: - A; video receivers user initiates functions including 
; Email, telephone, Internet : , access,* fax ahd : video-phone functions 
10 and viewing ^and storage of l selected- 'programs via selection of 
.-.options f$pm the . displayed ^program ^ guide. A 'User selects a 
.displayed option, with . avcursor using remote control unit 125. 
;i . Commands/ ^rom -remoter control 125 £re-' passed via interface 1 20 
to controller, 1 : 1 5j ; .withiri^cprocessdr^ 25; "^Uriit* : 14 5 ^controls the 

1 5 operatipn of the : elements ; M processor 25'^and responds to reniote T 

- control junit; 125 -commas r dita- and control 

I signal bus vCv Controllers 115 controls the function's of individual 
. elements within; IJpr.oqessorj 25- by setting v c6niroh register values 
7 within -these - elements:; with . control busi Gi Processor 25~ :; also 
20 supports the storage and retrieval Of r data from '-"storage medium 
105. via storage device 19,0. iStorage- device 90 is a DVD type device 
and medium 1 05, - comprises wa multi-disk 1 stack unit containing a 
plurality of disks in this exemplary embodiment. ;^ ; 

F Considering . Figure 1 <^iii detail/ at carrier modulated 

2 5: with video data received by. antenna 10, is* converted ' to digital 

6 form : and processed: by input processor 15. PrdcessOr V5~ includes 
radio,, frequency,; (RF) tuners and intermediate frequency (IF) mixer 
and amplification^ stages^ for- down-cOnverting 'the input video 
signal to a lpwer, frequency : band.; Processor 15 also includes an 

3 0 analog to digital converter ^ for —digitizing the down-converted 

signal to produce a signal suitable for furtheiv processing. The 
* resultant digital output: signal is demodulated 'by demodulator 20 
and decoded and error-corrected "i by* decoder- 30." The output from 
decoder 30 ; is ^ further processed by- unit 45 of processor 25. ^ J i 
35 :r ;; ^The:i.data\ provided .to ^'umt^4S is^in-the^fdiin -6f an- MP'EG : 

compliant packetized transport datastream as defiiied in r- MPEG 
i systems standard sectioxr 2r4 i &rid : inc'ludes J "pi-bgram 1 guide 
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information and the data content of one or more program 
channels. Processor 25 acquires and collates program guide 
information automatically from the input transport stream and 
storage device 90 and either Internet data server 83 or Internet 
5 connection service 87 (e.g. > America On-line™). The individual 
packets that comprise either particular program » channel content, 
or Program Guide information, are identified by their Packet 
Identifiers (PIDs) contained :wi thin header information. 

In response 3 to .control signal : C; unit 45- selects either 
1.0 the transport stream ■ froi»^ ;unit ; 30, or in a : playback ; mode, a 
. datastream retrieved from- , storage 'device 190 via -store interface 
95. In normal, non^ayback .opezatioa, fiittiivtdtiip pfcekets; that 
; comprise prpgram guide information' -ares identified :^by -unit 45 in 
the transport | stream; from uiait, 30 an* assembled usiiig ? PIDs that 

1 5 are predetermined . r and- c stored inr toenaA~>.\tkenk&y -fcf <'•' controller' 

115. Unit,,; 45 r rnatc^s ,,the sPIDsl of rrin^olning^ packets ? in - the 
tran^poxt r datostream from decoder 30 J with rpiDD values - pre-loaded 
in . control registers within .unit ; 45 by controller .11 15 . therefore, 
.? atc $te .broadcast program guide (SPG) information packets- m" the 

2 0 transport stream are identified: i by -unit v45 without additional PID 

■ ,i9f?nnf^nr^ntrp^<^ U^-^qitosia full: SPG> by accessing and 
assembling the SPG ; packets: that jare: identified and captured by 
unit 45. - 7 . .-iitor,;:-, . •■ "i.^ " - : 

The PID \ information that enables controller 115, in 

2 5, conjunction with unit .45, to. identify data packets that comprise 

individual programs is ! tefine4 : a prqgram or channel map. The 
.program ^maR , Jtssqeim*.. r^ID^c. with individual packetized 

constitute, a prpgram and is part of the SPG. - The 
SPG . m . a y a teo contain additional information-, e.g. packet assembly 

3 0 information »: supporting the = recovery, of. program guide data from 

the input . transport stream. !■,$:■':. r 

. ; .. . . Controller .115; also configures unit 45 using Control 
, si S na l c to ; select the .data, packets comprising the DVD program 

guide (DPQ) information deriyedj from: DVD istorage device. 90 via 
3 5/ interface )95 rn yidt, i 45 n .inatehcs:i«ip,PID^ tof incoming packets in the 
- packet .datastream from interface 95 with PID values pre-loaded 
, in contro^ registers within s: unit ;45 by, controller r 115. Gontf oiler 
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115 acquires a full DPG by accessing and assembling the DPG 
packets that are identified and captured by unit 45. 

A similar process is followed in acquiring Internet 
program guide (IPG) information from Internet server 83 or from 
5 Internet connection service 87 by telephone line communication 
via modem 80. In acquiring the IPG, data identifiers analogous 
or' the same as the PIDs 'used in acquiring the SPG or DPG are 
-matched " v with identifiers pre-loaded ; by - controller 115. The 
" matching function may be^ performed' "tifiifcf wi'thili"'iinit ' 80" l or by 
1 0* controller ? 1 1 S: The : pYo'c'es*- Tor at quiring ' program guide 
irifbrmatidn' r is' explained lir greater "detail' v iii the description of 

-Figure's-' 4-6.J-- <?-;•■••-" -y _ s .<". , , 

'.r':.:. " ^ Sti f he 1 ' " SPG, ir: ki^d IPG ■ "' information acquired by 

r controller is irlerged^by^ processor 25 ' to ftrt ; a^ttgAiii ' guide '\ 

1 5* -f or v display •Sracx>r£bratin , g Selection option's allowing ' "a User t^ 

initiate Email, telephone, Internet access, fax and Video-phone 
functions. In" merging the ^ita, tfrf acquired SPG, DPG and IPG 
"information Is' collated into 'two 'Teveis t)f "hierarchy terrhed iheme 
and "i topic and ; redundant program- guide inf ormatiotf' is - eliminated. 

2 0 l A r theme, "for example; " may include categories such as movies, 

sports^ weather; ; ^hs,° docurheMari^s,^ "riewV, etc. A' *topie~Ms a 
category within' a Yheiner for "example; a /"rnbvie th^me 'category 
- may have tdpicV' r ihbludingV cdmedy, ttfrifler/ >6rror, 1 ^en&' fiction, 
^ romance, adult entertainment^ etc\ Different or addildorial revels of 

2 5 hierarchy : iriay ' be 'lifed' •' ik[ 'coUatinY' "the 'acquired 1 SPG, DPG and IPG. 

information s involving criteria; 1 such as viewer age suitability, the 
period setting c^g^-cKntcttpoirary^W ' hiiioric^ Reviewer' "ratings' etc. 

' & nuittWf^of' j>rob'l«ms' occur in. tfollatinY . SPCK DPG 
and IPG information. The c SPG/ DPG ^and IPG information, 1 being 

3 0 'Worn different source's, may categorize^ programs by; different 

themes and topics " and ' may Use' a ^different sorting hierarchy. 
Furmerr me'SPG, DPG arid IPG data may' use cVnfUctpgj redundant 
' or incompatible PIDs 8 or other i: data 1 identifiers for identifying 
individual ^data 1 elements; that in Vbmpfise particular "program 
3 5 ; xhannel or guide* coritentr Co'titfoller 115; cre^fes^ a ^master J set J of 
"thebes and 5 topics mapping' the "SPG; DPG r ahd ^EPjG informatiori^to a 
* ; corresponding category* in 1 the'rrikstef set: F6r "example^ trie master 
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set may contain an encompassing topic-theme of 'movies-comedy' 
to which is mapped both, . a) the DPG topic-theme, of 'movie- 
, parodies', and b) the IPG Internet topic-theme of 'movie-synopsis 
index' (an index of web pages). In collating the guide information, 
5 controller 115 determines the topic and theme categories of the 
data in the SPG, DPG and IPG from pre-determined theme-topic 
codes. The SPG, DPG and IPG theme . and topic codes together, with 
equivalence mapping .information .for converting . codes,,. of. one 
service provider, to t^s£ pf, another, ar^ acquired from- the ; SPG ;or 
1 0 User defined data input to^procj^^r 25, n or are < pre-Jstored in 
internal memory within controller, U5.^Cpntrp^ler^ , f l 1^5 ■ ^ernbles 
the collated SPG, DPG and IPG packets according to thft csiegpries 
defined^ by tjie master ; set , ;of , themes and ;tppjics 5 ? f he assembled 
..collated; SPp,^ DPG and , IPG is y ?t<$QJiy ^eon|rplLer. : ,n5. in 
1 5 internal m.erhory ,fpr use- in forming ^a cpmppsitjs^pg^ 
; display.-,, •' : ' -- A '"i-~ 



, displayed, infprmatjon, , Associated^ with", th,e . ^splayed. ^ composite 
^ program guid£, vThe^ .npnrdi^aygd, in^prm^tipn includes composite 
2 0 program map, condUipnal access, andl network^ infoxmaiipn. This 
- n P: n " d iSp! a y5 ?d inform^tipn required ao ' 2 $upporj„Jwenti^ 
..assembly and decoding pf ,,tjbe packets Jcp^rising ahe composite 
. : pTOgram v f uide : ?? d :. J ; t fe associated „ program • content.^ "The 
conditional access information -* goyernsr .acpess , .to .programs based 

2 5. upon. User , entitlement, ; TH ,networkVinto defines physical; 

netw ? r , 1 ; param ® ters . suc h fi s^eliite -transmission channel 
. frequencies a^njd transp.pnd.er , channels, ,fpr, example. ; . 

f i :^? n ^ r -?M- er r 115 - ^ r ^ s ir composite program map 
infpnnatipn for the composite -program . guidej that, .maps . the SPG, 

3 0 DPG and IPG themes and topics to , the master , set of , themes and 

topics. Jhg composite ^program, map also associates. . dat^ identifiers 
• '(' e ' 8 '. PID^, yalues) with individual , packetized datastreams that 

constitute prpgrams .listed, in. trje composite "program guide. The 
~ composite, .program map Jn&rmajion may, also, include a dedicated 
3 5 indicator to ^ denote that f, . j^ri^la*?, program ~ has associated , 
^ ■ nt ® r ?f t ".^- P/S e { .lafprmatip^ayjUl^ forming composite 

p /°; gram : ^P-Mprpatiop.^ co^ftller 4 fjj. examines/ the SPG,. DPG 
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and IPG , information for data identifier omissions, redundancies 
.and conflicts. Controller 1 15. re-numbers existing data identifiers 
.."and creates new data identifiers as required . to produce "MPEG 
, compatible program map information for both "the collated 
5 program, guide information and the associated program content. 

, Controller 115 also forms MPEG compatible conditional 

_ access, information; and network; information from corresponding 
information received in the SPG,. DPG. and, IPG data. The conditional 
.access >-info^ - such e as: f encryption codes that 

1 0 govern .^access ,to ? .programs^; J:hat^ are^Ude|>endent~ upon : user 
;r !^ntiU . r nj5twprk information l * defines physical network 

. parameter^ such > : as; y^satellitec transmission :'-! channel frequencies, 
transponder^^^ internet access parameters associated 

,-With^the^c^ gmderjforridisplay.^^Th^ composite 

1 S^program, ^ map^ : , conditipnalt aeeesSIl airds). tfetwtfffe^ information*' 

supports assembly, decoding and displayi^of the- ^ program content 
! available; from :: the satellite^ storages and ^Internet server sources as 
-well t as ^the- composite -program* rguide; ~. • sbtvg z—^r-'^ "A 
- , r:^ L: ^ -Controller- 4 IS: r also infcludesi additional linking - data in 

2 0 the. non-displayed icqmposjte _ program • mapv ' conditional- access - and* 

networks information, The _ additional : linkingr data- supports - the 
User ^selectable ^functions such: as Email, * telephone, ^ Internet access, 
fax, , yideo-phpn^c /channel , tuning/ program recording and hPine 
control functions. „ ;Home^;eontr61;{ functions may sbpport User 

2 5 control ,pf. ^lightiiig .-.air' conditionings heating -and burglar alarm 

operation, rrfor ; example, r The -additional i linking data associates 
^access data, ;both; iwijhrdata identifiers* (t.gi : PWs) of ' requested 
f d^ta, and with ; -User rsetec.table -:>: menu : options iff the displayed 

composite program guides The access, data "includes identification 

3 0 codes^ communication . protocol codes* ~ conditional" access 7 cbd^s, 

Internet access codessi e.go URL i codes for web page and- Email- access 
L as well as telephone ;and fax .numbers. The i access data -enables 

processor r25 to- communicate with ; external: devices. • 7 

; , . 1 . , Ini;i order to generate .the* .composite ^-program - guide- for 
3 5 display, cpnttoller A 15;iretrieves : the:: assembled- aM^cbilated SPG, ~ 
PPG and IPGr paqket : data- .previously store;d v in- -internal memory . 
Controller ^L15:\;both r converts :the ^etneved ^data- to ^pixel dati£ and 
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formats the converted data for storage in a pixel representative 
.memory map contained . in display processor 70. In addition; 

. controller 115 creates User selectable menu options (for UsW 
.selection of Email, fax etc.) in' pixel data form for incorporation in 

5 the unit 70 pixel memory map. Controller 1 15 stores the 
formatted SPG, DPG and IPG pixel data together with the 
generated option* .pixel ; data in the unit ; 70' pixel map to form the 

■.. composite program guide nfot display;* ' : ' ~ - J ' : : - , ; : )r - ." •"' • 

.t . ^compositc^prograto'-Jguiafe,- ^mbmirig-iffle-SPG- "D^G 

1 0 and IPG data and ^ User selectable ' bpiioiis, is formatted " t 4 o be 

compatible with the linking,; data ;t lb the hon-disp'lav'etf -program 
guide, information: For. example" j a u^ser ■ selectable' ? optloir in the 
, disRlay^ guide; (e.g. for: a: telephone &ifcttony ; ifc- • ^sd'c&te'd-/ T>oth ' 
9 with,, acpess; idata,; for ittheo function (e; r gv^ *qtelfe^hbne T number);' ; and 
15 wi^ : data ? - identifiers, (e^PIDss for dat#-:=pa&ets> of ^transmitted ; ' Hid 
, r«ceived v tejephone, messages):- '>"<:>' %<? z~"> , [I a ?n:qqv<. 
. ; Display, ijprjocessorr -17^>. converts - r tbe !t ; Stored aitd 

formatted program guide datairrnto a Cictffi^etiCid&ar^niitiadee ' - affd 
.-9te m ^ anc =e;i CQmpOnents. .cThe ^uminkhce^- arid ^chrominance 

2 Os components,;: together, with , timing data ; provided by : c6htf oiler 1 1 : 5 

are ; pr,QG^ssed ,^y ; processor v70^ irii a. conventional^ ^manner t& form 
an . N.TSG -signal for display : onrENTSC'l compatible 'image reproduction 
.device; 75 e,g>b a televisiono or video ' momtorV-Proe'es^ in 
- another- embodiment, provider KGB output data for '-display' ?by" an 

2 5 RGB compatible reproduction ^evice:'or a high definition- telefvision. 

, , . Controller 1 1 5; rini ; conjunction Wfth^p1roc6s-sor -55 , forms 

an .MPEG compatible datastr'eam :6f compressed video 5 %hd autfio 
d H a i containing the: composite program guide ' ; and- program 
content. Processor 5 5; a separates system 4hf ©Tarnation ^intruding 

3 0 timing, error -and synchronization infoibiaiidri "fronv the 

datastrjeam f frpn) junit 45; and diverts aft -for: iise=<by controller 115. 

Controller .' 115;- applies thearsystemrt informtftioiT in controlling 

processor 55 tQ : pro.videii-rer synchronized, collated program and 
, composite program i^uide: -dataUogether ;with "syhchrdnization and 
3 5 error -indication., information, ifor 4 use' ■ an? ' subsequent program 

Gon te n t tfatej deconfltpression;.jby ?\ decoder ^65. ~ The- composite 
: program guide data, provided:; by ^ocessor ! 55 combines the v SPG, 



XX3ID: <WO 9847286A1J. 



WO 98/47286 



PCT/US97/17036 



12 

DPG and IPG data and User selectable options in a manner 
compatible with the program map linking information as 
previously described. The program content data provided by 
* processor 55 is decompressed by MPEG decoder 65 to provide 
5 video pixel data and audio output data to processor 70. Display 
processor 70 processes the video pixel data and audio output data 
to be suitable for reproduction by unit 75 as previously described. 

: 7i Figure 2* shows an exemplary displayed composite 

program guMe/'Menii feature's 8 7 33-85t)V show "program services 
lO ^and frri&kmsV Menti ' features^'" i?3' 3 J ^nd ^8'3'5" show .program channels 
which r iriay be'" invoiced "%nd ^displayed upon highlighting of the 
' : cOrre'spdndinfg menu feature Using; a User selection control such as 
; "r remote control" direWd' cursor, if' a lise£ ttghiights feature 8*33 
''with '' •^Ke r, ^ : curSo*'r7. Selects' 'menu •"•"option 833, /for example, 

1 5 prbcess^r 25 J tune i s J "to" television 'channel 1 $T jA&g^' and displays 

it oh unit 75 using ^ composite' n^ 
•'•lnfdhha'tion' : "id* '"determine' the' ^iinction "acfivated " and . associated 
* : tu'ning irif brmatibn (channel frequencies etc.)'. Similarly, if a User 

highlights feature * 837 , ' processor 25 ' tunes J*to' r ". receive radio '^channel 

2 0 FM 13 v for audio output oh unit 7,5.' Upon highlighting' features 

840-850, corresponding to ' Email,' tejephofte, fax and 'DVD 
record/playback 'functions' respectively, [~ Wditipnaj , function 
specific menus become displayed . proyiding further "'.Ulser selection 
ootions. Such function specific menus may provide a User with the 
25 ability to edit, store "and delete" "access information including, for 
" example, telephone numbers, ~ Email addresses,, internet; addresses, 
credit card numbers and additional conditional . access data. t 

if a user highlights niehu features 860^870/ specific 
function tasks are initiated. 0 ; Upon "aTtJserJ .highlighting feature 860, 

3 0 for example, a further menu is dispiayed prompting the User to 

"'im'ter ari v £mail' message to be sent to John Smith at his home , via 
an Internet Email address retrieved from the /composite non- 
'"'displayed ""'program ' guide 'Mdnna.tion.*' Similarly", "in response to. a 
User highlighting feature 1 865, 'for ' example, " .controller / 115 if}®**? 
3 5 1) retrieves Jean's" "home * telephone number from/ Internal memory 
using the composite *' no^isplayp d' _/prog>am*' guide information. 
Further, controller 115 establishes' telephone communication, via 
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modem 80, with Jean at her home by dialing Jean's home 
telephone number. Also, upon a User highlighting feature 870, for 
example, the movie 'Star Wars™' is re-played from DVD unit. ,90 
(Figure 1). The communication between processor 25 and DVD 
5 unit . 90 is established with access data retrieved from memory 
within controller U5 " using the composite non-displayed program 
guide information. 

In addition, the program guide may include one or 
more icons, such a$ icbn 873 (Figure 2). depicting a home, for 

1 0 example," to' indicate wriethW IntemeV information . su.ch^ frs. j^'tiome 
page' is available '• foT f 'i ' 'par^puiar' ^ro^m, f .jf]^i|(eir',' icQn 873/jn 
Figure , 2 may' change' ^ jtp & .greeAr to Jodjcate 

.Internet ..' information is ayailabl^e for " a 5 ^arti^ja7" program. 

''\ A li *™^ire\y, "jcoti "'87|'*may ^ . t a' Vq&-ft|jj ^on whiph appears as an 

1 5 indication ^t'Jnterner information. 'Is n .avaijabie" foV a', particular 
' r> program- The ^ispteye^' program guide may be formed ^tp^enable a 
,. P s ** to request Internet information " on a particular program by 

highlighting the pjogram followed by f highlightrn|. jhe 'pqp-up ^ icon, 
for example. Home page icons that are present when t Internet 
2 0 information 1$ : ,>v*dlable : 7 may'''-also" located' within or ad|acerit to 
^ program icons, e.g.'] icon 859. Further, tiie home page ic °n may 
change color upon 1 yser : selection 'iof the" information bv 
highlighting' , the home page icoiC ^ 

Although Internet information may be retrieved upon 

2 5 highlighting a web page' icon such as icon 857, in Figure 2, this is 

exemplary only. Retrieval of Internet information may also be 
initiated in a Variety^ of pother 'jways.'.'A user may retrieve available 
Internet, inforrhati on relating to ,a program, by " highlighting a 
program icon, such" as 'Seinfeld™; f using icon 859: followed by 

3 0 highlighting Internet icon 81 0, for' example. 

"Upoii User Selection of a composite^ program guide 
function, ■ _ contrbUer" 1 15' (Figure 1) .deteTmines arid applies the 
access data associated jwith both request and' "response operations 
involved'-' in tiie selected' function. ' Controller 1 i 5 ' de'termines the 
3 5 access data required foi ; 'trie" request, and response operations from 
the previously ^ formed non-dispiayed composite' program map, 
"conditional access and" network" information. 
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Processor 25 acquires information, such as web page 
. data, in response to a User request, in a number of ways, 
including, for example: - 

5 a) In a first configuration, processor 25 accesses web 

page data that is continuously transmitted in the satellite 
broadcast received' from decoder 30, 

- by In a second ! cohifiguration, processor 25 acquires 

1 0> web : .'page data : that is ^ transmitted in' the satellite broadcast 
t; received from decoder 0 30 in "response td ail information request to 
a x service provider Via teiepHone^ lirie, and' ; 

• r -' : - c) c Iri r a ^Mrd-'-confrgufatidtf,* processor 25 both requests 

1 5~ Information 1 ' and feceiivVs response infbVmation ^ori" the 'same - 

commiinifcation ' link e.g? bh the : telephone link to sdrvfer 83. J 

> Firsf r cbnfigiirati€>n : of 0 Procesisdr 25 

2 0 ? >■ " in the^ first Configuration, web page data selected by a 

User via the displayed program guide' is cbntinuously transmitted 
within the transport dataistr earn 1 Input 1 to" processor 25 from 
decbder 30. In *thls cohfiguratitfhr^the f boniposite program map 
'information contains predetermined PID ' Values^ for the requested 

2 5 web page. Consequently, the reqWsted^web page data is retrieved 

from the input transport stream using the composite program map 
information without 1 the heed for fi cbfttroller 115 to communicate 
with a service provider Via 1 modem 80. In this configuration, the 
web information available to a Usfcr is limited to the specific 

3 0 information that a service provider Continuously ' transmits r to 

processor 25 using dedicated * transmission bandwidth. However, 
this configuration is simple ahd offers quick web page "access 
(since the web data may be stored locally at the encoder by the 
service provider). This configuration also minimizes the service 
3 5 provider burden of data acquisition and eliminates" "the need" for 
processor 25 to communicate' web- page^ request information" to a 
service provider. 
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The web page information, encoded in HTML™ and 
Java™, is packetized and formatted in an encoder by the service 
provider for incorporation into the MPEG transport datastream. for 
transmission. Figure 3 shows a data format, according to the 
5 invention, for packetizing Internet, data for transmission within an 
MPEG compatible datastfeam. A sequence of HTML™/Java™ ,web 
pages (705-720 of Figure 3). is formed by the encoder into non- 
compressed packets with ancillary information and HTML™/Java™ 
data. (725). The ancillary .information includes .PID values, a packet 

10 count value, and individual wjeb page, size (e.g. number : of,feytes or 
image pixel .size). The ancillary information , may, al^ov include; a 
flag to indicate that -a _ P { ar^.cu-lV^ ; ^sport :^pa^ 9 ^ ., contains., web 
page information; a start code; a web page identification code; an 
error correction code an d . a .timing , parameter ; suitable for 

15 synchronizing vfeb pa^ an asspciated , 

video or, a ud ip program. The web., page' flag imay . be u.sed to 
facilitate identification and separation of the web page 
information from the MPEG cpmpressed , video [ ; data. Further, . one 
or more elements of the web "page ancillary ^ data may be included 

2 0 within User definable elements ...of ..the MP/Ep transport syntax, such-/ 

a t s within the transpc))rt header, or it. may be included along, with 
the web page information in the MPEG transport -data payload - z 

- ; -••^^:..,f? s P-?.? se J -j J web ^ l - P a g e : -information, including a 

predetermined PID value, is. incorporated . in the MPEG compatible 
2 5 transport datastream input . .to.,, processor \ 25 (Figure 1) by the 
service provider. The response channel predetermined PID value 
is also . prestored in ^ controller ; ,1,15 internal memory and 
incorporated, in the composite program map information. As an 
alternative, the response data PID value and associated program 

3 0 map data may be encoded,, for example, in a Channel Information 

- Table.. (CIT^.. in : a .high definition, television. .'(HDTV) signal encoded 
according to. the Digital Television Standard for HDTV 
Transmission of April 12. 1^95,^ prepared by the United . States 
Advanced ^ Television. Systems. Committee (ATSC). In such a case, 

35 .. pne - , or m ? re *s?£* c jfr? -P^M^ffP!"? 1 ^.. Program channels , may be 
designated to , conyey. ^web. page , response information. Further, the 
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PID values , of the program channels - may be conveyed in a CIT in 
the composite program map information, for example. 

Controller 115 derives the predetermined PID value 
corresponding to the requested web page " response information 
5 from the stored composite program map information and loads it 
into control registers -within unit 45. Unit 45 matches the PIDs of 
incoming packets of web page response 1 data in the transport 
„ datastream from •■ decoder 30 with the PID value' pre-loaded in the 
• unit 45 control registers. The Vpackets with : • PID lvalues matching 

1 0 >the-jpre-determMe(t-" w-«b oreSp'otfse -"PED lvalue 1 -"are" identified- as web 

:page response ('data and are J provided 1, by -unit 45 to a dedicated 
: ' buffer -in I decoder' 55 i- -The- dedicated" buffer in ' transport decoder 
;;55 holdsHresponse ^data* t0J' be ^ -decoded : by ''processor 6*0. r 
, r ;! J- r;$»ro"G'ess*>r 055.0 derives fi system information including 
15 timing, - error i-ahU ! ^ synchronization; °rnf6rm i a l tion from ' the ' 
datastreami-ffiom^ <tinit «45--and "- ^rovldes^^Ut 5 t6' ; ^ntrbllef 115. 
•: Controller 1 i 5- * applies -the -system : ~ information in directing 
> : processor :i§5 « *to-"provid6 1 >te*sy'fiafironlzed J » web page -response data 
from 'the • dedicated buffer - in" 1 decoder : 55 *■ to ! HTML™yj ay a™ 

2 0 processor 60. Processor i60 decodes': the'^ HTML™ and Java™ encoded - 

Web "response information "-and provides web" page image 
representative" pixel data for * storage - 'in c memory within controller 
;. us. Alth6ugh ! processor 60" is shown -as a' Separate processor in 
Figure 1, it may also -be •>ifii'plemehte^-'lvi'thi-rf' : -^h% Software • of 

2 5 -'controller! 1 151 ^Proc6ssdr "60. comprised the processing functions of 

a special web 'browser, including! JPEG decompression 1 anil Java 
decoding 14 such as '"•* involved' 15 -"Un* • tn*< :1 ^per'ati©iF of Netscape 
Navigator™^ for exarnple". • - : 

Program content data e.g. "a User selected television 

3 0 program channel; wiihin the ■ ^PEG' compatible transport 

datastream' ^ from- decoder 30,: 'is also decoded • into pixel 
representative ■'• data by processor 25 : in addition to the '-web- page 
• response - data! For this purpose/ controller 1 15 determines the PID 
value of -the " selected : •' teleMsioir" channel 2- '• program • •• from- the 
3 S-'composite^'prdgram 1 .- map 5- information - -and loads c it into control 
■registers within unit.* j 45: Unit " : 45 -matches the -PIDs * of incoming 
packets "of Selected - television :- 1 cTiannelv program 'data in the 
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transport datastream from decoder 30 with the PID value pre- 
loaded in the unit 45 control registers. The packets with PID 
. values- matching the pre-determined selected television channel 
program PID value are identified and provided by unit 45 to a 
5 dedicated application buffer in decoder 55. 

As previously described for the web page response 
-data, processor 55, derives system information. .including timing 
error and synchronization information' ftOm the datastream ; from 
• , unit 45 and .provides;;it to v; cqntroHeT U5,.. Controller, .1 15- applies 
10 the .system intormatipn, in vT^Q^^TO^wsoii^ftS. itoj 3 |»ovide-. re, 
synchronized program channgj v .ppnt^ d a t» ifefim -the- application 
buffer m decoder 55 ? to. MgE£3 decpder ; 65. : Thft MPEG ceomp&tible 
program channel coptenMajff- is ^deeompre^s.ejd ?byocMf?EG decoder 
:;v 65 . to. provide, video mm'>fa*&4t &mo. mmt-m& to display * 
15 processor 7^ L T.he v yideo ^X^^fym^tQsOgt 6$,is : stored dh> a 
- : pixel representative memory- .contained-, in display . .process or ,70.; 
v ■ ;•■ Conttqller/ ; 115 relieves the web , : page image , pixei data 
from, J^nal memory , a l id ; .f ft nn a tft r j.t : foBSstoi ; ^e. as , t an overlay,. , in 
tHe - Pixel represpnta^^^ prosestsor 
2 0 7p. n As -s.uch Sjnerged^djspte^^ page response :•: 

data and program, ; S&?iwe| ' cpgtcnt^ig : fc^ed within the pixel 
memory ,qf t processor, ,7,0., ^ relative, ;pr fl pqrtiQns . and sizes of .the 
w^b page image and phannei ^content, image w-jthin:, the resultant 
composite image, formed, in, .the processor, ,70 ^ixel ^memory, rfisy 

2 5 be varied by controller 1,15;, ki . response,, to ^internal programmed 

instructipn . or . e«ern a l, 2 .e, % . ..rUser, command.. .The. relative 
.proportions, may be. varied so. that, .either, t the , web f page image or 
channel content image contributes between 0-100%, of the 
resultant composite , image. „ , ,. ^ '. ^ 

30 ,:,In :- order to - adjust . the proportion = of the composite 

image contributed, by the, web page data,, ^controller 115 scales the 
web page image, .pixel , data by a conventional interpolation 
. -process. Alternatively, the data, may be scaled by a separate video 
processing , integrated . circuit operating, in conjunction with 

3 5 , controller U5., : The ^suiting , scaled web, page , image is stored 

within the .processor .70 : pixel . memory .by controller 115. The 
stored web page image rrepresen^^.an^pyer^y image with respect 
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' to the program channel content image. In order to adjust the 
location of the web page image data within the composite image, 
controller 115 determines the addresses corresponding to the 
; desired memory locations from internal memory map data and 
5 stores the scaled web page image data at the desired memory 
locations. As previously explained, display processor 70 converts 
the' formatted composite image data into conventional luminance 
and chrominance" components. Further, processor 70 "processes the 
' lu'mihkn^e'^ «nd' xhVbminWnc'e•'' components;'' together ; "with'_ timing 

1 0 data provided by' do^trofl^f 115,' in a conventional manner "to form 

:i an ; NT SC signal for aispte? c on v r?TSC compatible .image reproduction 
h de*Vice s "*751" ' '"• ' 

In the second configuration, processor 25 . of Figure 1 
a acquired • ,I 'weK'^ige t; ' ? dafi 'iriat'^is transmitted in" the satellite 
broadcast received ^from ' decode 1 ? 30 iri ' response to an information 
7 'requeit "fd ¥"seryice "provider ^vir a; telephone linel ^Uppii a User^ 

2 0 requesting web p^ge'ttata^ e?g: by' highlighting web page ic6n 857 

in Figure 2, controller 115 (Figure 1) uses the request- access data 
(telephone number, requested' wW v ptfge^Metltlfief'^5b^de• v -te.•g: , ' URL) 
and conditional access data) to establish communication with the 
satellite broadcast service provider^ " ■. " , 

2 5 Prior ! to establishing 1 cbmmuhication with the service 

provider, controller 1 '15 * "determines frbrri conditional access 
l? information whether kcce'ss to * * the ' requested " web page 
information* is * authorised. "AuthoVizatio.n "may be ' determined 
directly froin die program ' guide 1 conditional access information or 

3 0 "indirectly from a' 'User '',entiUement . device such as a smart card 

(ndt shown to simplify ttie*' 'drawing) u within '' processor '25 . " If "access 
is authorized, controller \ 1 1 5 s 'establishes' telephone cbmmuhication 
^ with' the satellite broadcast *'servibe' ^prbvTder/. Jby ' dialing^ a 
; telephone number via rpbdenT 80^ arid transmitting request.. 
3 5 information e.g. rVquesjted v>eb : pige ' identifier ''co^' (such' * as a 
1 URL) and 'user entidpment ^pde'^fh^ servic^proyider incorporates 
the requested wW'tii^e € ^6im^<m in * he ^anspo'rl' ""datastream. 
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transmitted to processor 25 via antenna 10, processor 20 and 
decoder 30. Controller 115 uses the response access data .(PIDs of 
the web page data, response "program channel number and 
transponder number) to identify and assemble the web. page 

5 packets in the ( transport stream as described for the first- 
configuration of processor 25. 

The . PID^ values of the response^ web page information 
and corresponding program map information may be 

, communicated between ^^seryice^proyidej:.- and processor, .25 in a 

1 Q variety of ways and. in a variety . of dato fprmats. t^e .PII) values 

and prpgram map infopnation^ : m.ay, be ^ conveyed^ £ox t j example, r in 
accordance with proprietary or custom requiremf nts ^ : pf ' a 
particular system such as within MPEG user definable data 
elements or within no^-MPEG data £uch, wi^n jh^ .ypjfigali 
15 blanking interval (overman 

signal. Further. the PID values allotted to the. web information 
may also be^ .transmitted tg ; ^roc^s^r 25 , in supplemental program 
guide .information. As another alternative, tfieT "Pit)" values \o "be 
used for xesponse _ data may be determined by a service provider 

2 0 from information transmitted from processor 25. , 

Third configuration of Processor 25 

In a third configuration, processor 25 both requests 

2 5 information and receives response r information .on the same 

communication f linlc e.g. on the telepiione Jink to server 83 or 
connection service v 87 v ,yia podem 80. In this configuration, 
. controller J 15 requests .Internet web page information by 
. highlighting' icon 857 ^(Figure/ 2), for example.' .Whereupon 
3 .0 controller ^ 1 15 ^Figure 1) u ?^§ ^ r ?Q!? es t r ^cdess data (telephone 
number and^ ^ URL . code ; and conditional access data) to establish 
Internet access and request web page, .data; at 'the URL address via 
modem 80 and server 83]./' ( ConttoUer 
. requested Internet access is . authorized from conditional access or 

3 5 smart r card User, ^ entitlement , information as described in 
^ connection . c with the second^ configuration of processor 25 . Iif 

_ authorized, controller 115 establishes telephone , communication 
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with a service provider via server 83 by dialing a telephone 
number using modem 80 and transmitting the Internet URL 
address code and user entitlement code, for example, as 
-previously described. Controller 115 uses response access data 
5* (including Transmission Control Protocol/Internet Protocol 
(TCP/IP) identification data)- determined from the composite 
program map information to identify and assemble the web page 
' TCP/IP packets containing the web " page HTML and associated 
'-JAVA data (and other data e.gV JPEG, GIF, TIF type data) in the 
1 6 response '* aia'sfream : \ff o*m' server' 83. - . " 

' ft'-. ^T^W : respordc' J ^h >l p^gt' :i 'TC^/tP ''packbt*'*- are buffered 
/•^•i^M /; mb&tem y '80 % 'ai^' 'provide* to HTME™ ? processor 60 under 
-command of j controlled l i5 : ^Proc^sbV 60 decodes ' the HTML™ and 
' j a va™ encoded "web"' fesr)bh'se : information" and pfoviaes 1 "wfeb page 

1 5 inrage representative 5 'pixel 2 d&ta° for 1 storage in ' memory within 

controller if? . Cohtrbfier 1 15 retf i^vfes " the" : web *page : image pixel 
1 data ■ from" internal; ^ memory 4 and 'Ybrmats ;0 it fbf ^orajge x as an 
" overlay in 'the pixel ; " representative memory 2 contained iri display 
^processor 70 c for reproduction^ by 1 ! titiii ri 75 " *}^*\$Sr^^disffi$; as 

2 6 'previously -described" In""'^^'''*©^^^^'©^/ "pro : cfcssor 25 supports ~ 

full Internet SiccesY'' via server '83 ^u'sirig- : thfc " displayed pro'gfam 
* guide\ For example'/ u|>on a User ! hlgnlignting ; -ic : o^^ followed by 
'icon 830 (Figure^' 2) controlier ' 115 (Figure 1 1> executes web page 
browser functions and display s : either -a eusfdrn Veb page browser 

2 5 " or a standard * broWsef display such' as ; Netscape 1 Navigator™ 

through > which' fuli Internet access is available. ' ^ : 

' ; " - Alternatively, in the third configuration; processor 25 
may support a Hrhited- Internet service, in {his c&st, access to the 
" Internet netWork 1 'via ; se^er 83 is under the control of a service 

3 0 'provider that allows o*hl'y indirect Internet' : access: The service 
• " provider provides collated we : b : ! page ~ ? informat?on~ for - display 

'compatible with the 'dispiayeid composite program guide, the 
service prdvicfe? 'stores 1 1 a limited" number" of web pages locally 
within server 83 that are accessible by" processor 25 using the 
3 5 composite program Wp * information Which provides an index to 
the available web r/a'ges and 'their correspdnding ^r^ 
•• piDs. ; Alternatively, the service" provider niay : alter the selection of 
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web pages available from, server. 83. and periodically provide 
updated compatible supplemental program guide information to 
processor 25 via the . satellite, broadcast datastream. ' J. ■.' 

The supplemental program guide information enables 
5 processor 25 to. form an updated displayed guide together with 
compatible program map and other access information enabling a 
User : to access , the updated web information, By storing , the web 
.page Internet, information \ .locally Jn server 8,3, the -service 
c- provider retains coatro^j>f .-the Internet content ay ailabje, to a . User 
10 and is able to bill the User^fo^ )h<i maJeriaV p/pyid^d*' 1'^$,'.' the. 

!. local stpfage.pf the -.^»b_.pag^ ^infprni.adQn.!.in,\'serYipr T '83 provides a 
■ r ^ ser . with 3$ 8 y?h accfJ5Sf"itO' the information,' without jthe^/uDj .,deLay 
associated, with , normal , ]^te.rne ? i ' apc6is., "typihet^typ* "jbar^en. ]pn 
, 1 .proc,essor; ! _,^ {: o j f cpmmumeatjng,; info.rrpatior^ ^eque^ts^.^ 
15 '.devices is , minimised. in. that o^ly aj ; limited, guamity^f Jnteqiet 
j ... .infoi-matio^^.^may Jbe^ f requited and ^processor ,25 1 nee£ r pnly 
communicate" with local, ^servers such as server 83*. It'is \to J)e noted 
^ at , m ? den ? :* 0 ^ m ay_alsp, b J^» a ^* de ■jb^d^i^.'^poipmuniqa^n 
. mpd £ m . s V? n as a ,; ca ble: ^ n Qase^ processpr' 25 may 

2 9. de ?. ode both • ^ eb P a ge idata^ and. brpadcast video prpgram 'd^ 
, , display from a cable, program 1 , source^ via .! modem. £0. " r ^ \ . , . V 
v.- i , . • "j i< ■«■ £p n ^ ler ^M' 5 enaplpys. the method shown in. Figure 4 
, to produce, a display ed ; program guide by. prpces sing, ajid 
formatting received ,prpg£am guide information 'that already 

2 5 includes User, selection menu options. • f Th^pipp^s of.' Fi^re 4 does 

not require processor^, .to ja&.Q^ spl^o^^ijnu Options, and 
may > be emplpy.ed by . processor 25^ in "itsT ^t "configuration, ' for 
example. In $tep 205, following the .start at^stepr ipb, processor .25 
.» receives . a transport datastream : from . decpder 3Q, that incorporates 

3 0 User selectable,, .menu . . options , fpr/^sp)^' as part of .the, displayed 
. program guide. The r. Usee - selectable options support User ' initiation 

of cpnimunication f ; unctip^s such as Email, telephone, ^Internet 
. access, .fax, . yideo-ph.pn.e.^.phann^i. tuning, program , recording and 
, . home, control functions. , .. 

3 £ , -^f/c data . T y£$ y S$ in |^p. . 205 also includes additional 

; ;. 1 f nkin S' : $*t*„$k. A e ^P/Wani^-gu^de' ' ' information. The additional 
, , linking data" . ppmprises. program map, . conditional access, and 
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network information and associates access data with the User 
selectable menu options in the displayed program guide. The 

5 .access data includes, identification codes, communication protocol 
codes, conditional access codes, Internet access codes e.g. URL 

5 codes for web page and Entail access as well as telephone and fax 
numbers. The additional linking data enables processor 25 to 
assemble, decode and display the program content and program 
: guide information in the transport stream from decoder 30. The 
access data Enables processor ' 25 to communicate with external 

1 0 devices r and includes different -address^ representative codes 

: correspdndiWg to ^dresses- of *> different 'information sources. In 
v:step T 2 1 Q; i donfcrollfeV i: 1 1 5-" 1 d us6s -i predetermined linking data PID 
• rvalues" stfereti? iti Eternal- memory^ in directing 1 probeissor 25 to 
^ identify arid ^capture the -Ifnkiiig - and r access^ data'^roni' the received 
1 5: program -i^uiae^-ihfortfiftioii. The* captuired ' linking data is 
assembled, formatted and stored by controller 115 in internal 
~ c rilemory in :? Vtep? 215. Also, in * : sttfp' r "2lS; additional linking data 
/ sach as Ihterhet or Email - addteisses or telephone numbers may be 
/entered- by a User r via~ an" entry devicie such is a" remote' fcohtrol 

2 0 unit and the Additional data is incoi^ofated in the received lihking 

data by controller 115^ v " 1 ; *" 

The program } ^guide information containing^ the " User 
Electable optioiis, is r -formatted fcir display ' by contrbllfer 115" in 
Conjunction with display -processor 70 witliin processor 25 in step 

2 5 220; as previously described in connection witti Figure I. In step 

22:5, display processor 70 r cbnverts : the ( stored and formatted 
program guide data into cohventibiial luminance" and chrominance 
components. The luminance and chrominance "Components, 
together with ti-rnihg -data provided by controller 115, are 

3 0 processed by processor 70 for display on reproduction device 75. 

The process- of ' Figure 4 terniinatfes' at step 230; 

■ -Controller 115 (Figure 1) T employs' the method shown 
- in Figure 5 to produce a program 1 guide in a " video decoder from 
information received frbmv a < phtf&lity " 6f ~ sources . The formed 
3 5 guide supports User , selectable "communication functions e.g. 
Ihternet access^ 'Email/ fax ^ etc.- . ^In step ^C&y Allowing the statt at 
step 300, controller 1T£ acquit s Cf ^ateUitfe : program guide (SPG) 
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information from the . satellite broadcast transport stream received 
. by processor 25 from decoder , 30. In step 310, controller 115 
acquires DVD program guide (DPG) information from storage 
device 90 via interface 95.- Controller 115 acquires, collates and 
5 formats the SPG and DPG by accessing and assembling respective 
data packets, to produce SPG and DPG representative pixel data for 
storage as a composite program guide in the unit 70 pixel map, as 
previously described in .connection with Figure ; K l^e T SPG and DPG 
information includes .linking and .access data in .the, form, of 
10 program ; map, conditional ;_,acc<;ss ,-and network information. In 
other configurations, prppessor. 25. , applies ;-. the prinGi^.es , deteiled 
herein to form a composite,, p^an* f guid^ajje^idingi ipro-gram 
, guide information, derived,; irpm f: ,a c source ^uah as-,, ^ terrestrial 
■ broadcast ; source, a, , cabje, broadcast ispurce, a, computer source, a ' 
15 radiq transmission source and : a s oujce - ^ apcessedfrvia telephone ; 
. lines. ...... , .. 

•■ •< '• •* ••' ■ " -.i r ■■■ ■■ r.c . v:-. c ■. \.v . c/j.iw ■.:.-:■/: ■ '-.l -,■ 

; \; . In :v s * e P ; 31 ^. ..controller 415. crea 4 tes r . User selectable 

, menu options for display (for User.s^ 
Email, fax. etc.) in pixel data , form- fpr incorporation .in the unit 70 ». 
2 ? n P^! memory map. In step 315, controller. ! 15; also qreates User.,? 
determinable menu options that enable a -User, to customize .his " 
program guide tp . include an icon that . performs , avspecific User 
•requested function, for example, a User may require, an icon . that 

^accesses a specific internet site, or results in a display of all 
25; received messages. CojitroIler T: 115 -resppndV to. commands entered 
via a data ^entry device .e.g., a ; remoter-control unit or keyboard in 

i <* eat W tne i: y se ; r determinable, menu option > in accordance w k ith 
programmed instructions. 

.• , .Controller 115, jn step.320,. examines . the . SPG and DPG 
3 0anformation r for data identifier (e.g. Pp) -oimssix>ns, and conflicts. In - 
step 325, controller 1 15, . re-numbers existing, data- identifiers and 
r allpcates new (lata , identifiers as required to produce compatible 
Program map information fpr both the collated ~ program guide 
information and , the associated, program content,, In step 330, 
3 5. controller 115 .fofms. v c W posite. ^program map/ conditional access'- . 
;,; an 4 ^ e ^ wor * : i n f°r mat l on for ; the compete .• program', guide, -in.' the 
^ manner^ described in connection, ..with figure 1 . ... . ' ]\ 
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- The composite program map is formed to enable 

processor 25 to perform the communication functions selectable 
via the composite program guide. For this purpose, the composite 
program map' associates a communication function PID and menu 
5 option (e.g. web page, Email, fax icon) with' the different address 
representative codes corresponding to 'the addresses of the 
different information sources. In step 330, controller 115 also 
incorporates' User entered data into the composite program map, 
conditional access 'and "network information^ This data may include 
1 0 items such as an Email address, a telephone/fax number, ' an 
Internet ;i w6ti s page liWk laddfess; 'a! credit, card number etc. The 
'y^er^enteV^'Ms 1 dati/'to { ^roH^sstrf 25 via a 'device 'sucti 'as 'a remote 
coiitrbl oFky^boaVd? Conifer ilSV'^n step 335, "forto^ts the SPG 
'and 'pPG^'""ipiX^"' l daVi j together with Ihe ; menu ' option pixel' data in the 

1 5 "u-nit j: f0* o iiixei 3r: mip 2 yreMeU-in : ' step 1 3T5 2 . to form'V composite 

• "AT (_T-. -yj.' : »r«--. '. ' „ 3lCi.~ 'V« >: . J-Z*. V" 

'program guide for "display^. , - ; - . , 

t » 1 * r . . xh| r "'c^mppsite z program guide' information containing 
'the User selectable /mertf : ojiti^s is formatted for display in ,step 
°340; and output ; ih step 345 as ' pWviously described in connection 

2 0 wim Figure 1. The process of Figure l 5 terimriates at' step 350. / 

' cdntroller 4 I15 '(Figure'' lrehipld^s toffee's* ''df JFrgifre 
6 to automaticaiiy acgui're ; &d "'coirate prbgfkm guide f information 
from a plurality 6T sources to form V co'mposite program guide for 
display. In' 'step c \405; : ;;Mf<iw|n4 Ae^ start Jaf step 400, conttdller li5 

2 5 acquires and stored s^ieilite f : pfog^m r guide (SPG) information 

from the satellite 1 " broadcast transport stream ; received by 
processor 25 from decoder Conirbller^ 115; in st^p 415, 
automatically' initiates" 1 cpirimUnitatipn ; with" DVD "storage device 90 
(Figure 1), Via interface '95 : . The communication is" initiated u£on 

3 0 power-up of prdce^or ' 25 in " response ' to. pre-stored hardware 

configuration information defining ' ;he„ peripheral devices that are 
attached to pipcessor '25 and the ; " associated" '''communication 
protocols. This infbrmation may ? be "contained within trie received 
program guide 1 '' infonnation, or 'jmaV 'W's&reti w^ih. |rpcessor 25 
3 5 at manufacture, or map be ' determinfd locally ^by processor 25 of 
fc rnay be determined ^ through 1 a combination of these ;rhethods. the 
' local determination o : f'*'n l aVdwar ! e -configuration .' by'* prdeessor "25 
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may be accomplished either by. peripheral interrogation initiated 
by controller 1.15, or by Us.er data entry of hardware configuration 
data. 

In alternative embodiments, communication may be 
5 automatically initiated upon conditions such as, a) User command 
via a program guide, option selection, for example, b) peripheral 
interrogation, initiated by controller 115 on a periodic or 
intermittent basjs, or c) detection flf a new , or changed electrical 
connection of .processor 25 to a peripheral, device such as DYD 
1 0 device 90. "."..'■!/' . /' " ' ' " : "'[ 

.- .-Controller' U5 ,Jnitiate^.,6pm^m^ 
90 via interface £5 us^ng.. p^m o mynicatio|i protocol ..' codes, 
identification ^ codes, entitlement co^sl^andt so^^Xo^al t ' access 
codes retrieved frp'nj, . me .access !d ; at ji* ' wi't^ t|c?^ej^.ed program 

1 5 guide Jnform'atlo^. In'sj[e^*42p7 cqmro^^^^c^^oc^ssor £ 

to acquire, and assemble the DVD prograrnV guide Iriformati^ 
derived from DVD ; storage device, . 90 '! yfo jmterf a^qe 95 in* "the 

L , mann ?r preyipusiy d(e^c.ribc4 in" P^fetio^~\wiA^^e 1, In §tep 
425, contrpyec 11 5 cpllates , the SPG, and r DPQ. information by theme 
20 and topic^by, .map^piri^ 

; ^prresppn^ini^pme g a^d!.. tqpip^cf tegpriesi' *in a Jrnastei; set, 'also' as ' 
described in . cpnnec^ 1. FuVtoer/in step ,425, 

conljojler f cpUa^p. jh6. jSF^ and '^PG X^ormijion ' source '! and 

, allocates a_ • .diffeTent^po'lor : §t$butp to. -programs 'and" program icons 

2 5 from different sources . In /addition, ppntrpller " 1 1 5 /creates menu 

options, permitting, a User to sprt by spurce and i'xlolor. 

v ; c. ^ e 7 . .sjhio^s^a black and [white ^representation pf a 
cpjpr Program' Guide", display fprmat, according to the invention, 
showing menu, options created, by xontrpller .1 15 permitting a User 

3 0 to collate ^prpgrams by source and color attribute. , Source icons 

905 ; -925 . ar^, associated, with offr.aif broadcast, cable, radio, * 
o satellite _ and storage X.P-g/ DVp source, 90 * - Figure 1) respectively. 

Source icons 930t95CT are "associated with Email, telephone, 
? videophone, fax ang /internet ' function sources respectively. Upon 
35 a ;.User, highlighting source icon 905, for, example, a program guide 
*f d -^-P? a y^ d ^ h Pr in S .off-air!' broadcast programs and,^ associated 
ic °ris.. Similarly, uppn <; a* ; U spr^ Ji^jgb^ng ' • spurce icon !930, for 
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example, a program guide is displayed showing Email icons via 
. which a User may activate menus for initiating composition and 
sending of Email messages and reading and deleting of messages 
received. 

5 Icon 900 is a "rainbow" sort icon showing a spectrum 

of discrete color blocks represented by shades of gray in the black 
and . white program' guide depietion of Figure 7. The color choices 
of icon 900" may Alternatively be arranged as a' continuous color 
.spfectrufife of- selected ; rang^ !j of ^ Hcofors ^ini 1 '^ : sirigle or a 'number of 
10: discrete" color : blbcksi ^on 3 a "user nighlrgiMtog^ particular color 
within icon 900, programs from- the ^urce ' attributed with that 
^particular 'tfolS2 aire" -^isplliyed. : For- : example;- assuming in step 425 
3 controller 1*5 "mffi-bu&T Hhe' -ebloV : p'iApl'e' : *fo tr "tbe-' WfiE)' source device 
;90, then upbn ^u&i^l&gfcti&fflg 1 &e ^ cdlor r ^a^^e :J .wii•&^h , icbn .^00^ 

1 5 the movies Available- frbm-BVD -device; Ht a become 0 di^pla^ed as' tf 

^prograihT-^id^'^Alferaa^Wely'r ^'e^'color'-yoliatioii^Wfi^me "may be 
used -to identify 1 • prdg>ami :1 by- -other c cWeria ^ftian* ~souie'e . 7 Color Way 

qbe° used as-al ^tribute 1 tb^dentifjr r proii^s u: b^- or topicV 5 for 
■exarnpler (it which- case a ? "display of I movies available for viewing 

2 0' from all source's may oe : -identified 5 J by -highlighting "a T^red'' color 

^within icon 900 ; , for example. ' in addition, 7 prbgraW guide' data 0 may 
: be collated 1 by Attributes -dther than 0 color? " Por Example, 'programs 
^from ' different -sources may ' be attributed with different types of 
shading or 'different icon' shads'- T a*d>geo^etrys. ;' ; . 

2 5 c r "-•••''Cbniinttihg' -with" the*- : prbeesV-' : bf -figiire- -6;;in'-'step 430, 

controller '1-15 forms ; a' cbmp^ite- program guide 1 for display from 
-the collated SPG and -DPG i'nformatibri^ in ;a manner "similar 1 to ' triat 
'described - in cbhnectibn :witti f Figure IV' Controller 1 15' also, in step 

425, ; 'creates associated 1 'User selectable' menli options 'for display 

3 0 including the User selectable program ; guide options for : sorting by 

'.Source and color The treated TOenu' options 'sire' Mcorpbrated 1 by 
^controller 1*5" in* step 430 in a -composite program '''guide "^f or 
display' : as - ^exempiif ied ! f in Figure" T. In Vtep 435 contfoUe? 11 5 
formats the composite program- gi*ide ; information 3 for display " as 
3 S 1 previously described^ in". -abiineedon'-'Wiffi-*' Figure"; 1. The* process ; of 
Figure 6 terminates at' step €40. • " iJ ' J -^ - 
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Controller 115 (Figure 1) employs the process of. Figure 

8 to acquire web page information requested by a video receiver 

User via a . selection made from options on a displayed program 

guide. In step 505, following the start at step 500, controller 115 

5 retrieves access, data in the form of a : telephone number and 

Internet URL code, for example, r from memory in, response to a 

. User selection of a web. page made, via a displayed program guide. 

, The ,access data associated . with the ypar^cular , ; ^ser, .selectionnis 

determined from ^ Program r guide; .database^ using, program -map 

1 9-* n ? or ^* tio %. 4 ata associatecli.^with. y&n pa^euiar 

program or program guide function: ^ , 1. ; , , ^■ rn „ ; 

> q rr -? n j.r.-?^p5 51 $ t ^£99 tr 5$*r bl-, 1 & ; pfpjgcssgr i? .-;25 lfi: fo • 

establish^ a request, .^omjnunie^^^^ £83 by | : dialing 

f he ^trie.ved 7/ ^Pko^iW^ 1 " p Ji^ffl^P^kts 80. n Aljso.r. i|» step. 

1 \ 5 ^ , b P*?^*°§(iP. >^§ de &; ./^clW^&fc additiojiaj 'access data * 

ppmmunieation . on. the .l^^t. « ^m^.un|c^tiQn link, ; The .required 
ieF?S°f£ J f?' #?M! min v ed ^M m ., ithe-^gnun 7 map ^ informatiqn.v In, step 
. - ^2P'; .cojitpller f 4i 5 4irects , processpr ; £5, to , receive and; %cpde r an 

2 Q ^nput . signal ^eppiy ed , : on a : , response ^ommunicatipny link. Controller? 

■ . -M 5 jsr^ftf f ^'!i ■■P^??.? ( ?S° r ;n^«?iL in n* d ? ttt |f>« n g v and ^ -retrieving the 
f es .P? n ^ e ; w f S J>age. information, from . ; tfie input signal «l tSteps 525 
^ and ; ^ 30 : r?^ eren ^ . meth ? d i s JI* > f s rejteieying response ; data, from , the 
input signal are err^lpyed, ,,by; processor 25 in t ,.steps 525, and, 530. 

2 5, The selepted, method ^pjnds ^on ^hether : > or :i nc)t ^the response 

communication link ^is the : ,, samel JinJ^ ^ r used £ fpr | -the wpb ^page data 
request. ;? The . rnethods ...uspdi^n^^den^fjrMig.. : and— reprieving the 
response data arp. .similar, to 3 those^- .preyjpusly described „ in 
, connection .with, the three ; , ; configurations, of ? .processor : 25. 

3 0 CQn^-oller, :v -l lg, -apjrtiejs. rr^e ^appropriate. ^^nligura^Qn.^ methpd : in : 

^identifying, the response; ? web t page data , in the- input signal, in ;i s,t§p 
^ 525 ?- r For - f P ur P°?-fi» .-rc^^olier _ ( . : 1.1 ^ Hses data identifiers 
t det ffl in 5 d ^9?°^ Pf°Sra m , raap,._ i _i|rformatipji-;. - ; that, .associates the 
identifiers with the ,^User ! program, Iguide selection... jcontroller 115, 
3 5. in step^ 53 : 5p formats the response w,eb. : page , information for- 
display and the Figure 8 process ends at step 540.. -. 
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Controller 115 (Figure 1) employs the process of Figure 
9 for decoding both input Internet information and compressed 
video data to form a composite video output for display. Following 
the start at step 600, controller 115, in step 605, determines 
5 packet identifiers for User requested Internet data and 
compressed image data from program map information: In step 
607, controller 115 determines whether access to the compressed 
video- data and the requested Internet data is authorized from 
conditional access or smart card User entitlement information as 
1 0 previously described in connection with the third configuration of 
processor 25. 

If access is authorized, controller 115, in step 610, 
identifies the web page TCP/IP packets containing the web page 
data in a response datastream from server 83. Similarly, if access 

15 is authorized, controller 115, in step 615, identifies the 
compressed video data packets containing a User selected video 
program in an input transport stream from decoder 30 to 
processor 25. Controller 115 identifies the web page and 
compressed video data packets in a similar manner to that 

2 0 described in connection with Figure 1. 

In step 617, controller 115 directs processor 25 
(Figure 1) to decrypt Internet or compressed video data if it is 
encrypted. Controller 115 in step 620, directs processor 25 in 
decoding the identified Internet web page data using HTML™ 

2 5 processor 60. Controller 115 in step 625, directs processor 25 in 

decompressing the identified compressed video data using MPEG 
decoder 65. The resultant decoded web page data and 
decompressed video data is merged, formatted and displayed on 
unit 75 using display processor 70 under the direction of 

3 0 controller 115 in step 630. The process of Figure 9 terminates at 

step 640. 

The architecture of Figure 1 is not exclusive. Other 
architectures may be derived in accordance with the principles of 
the invention to accomplish the same objectives. Further, the 
3 5 functions of the elements of processor 25 of Figure 1 and the 
process steps of Figures 4-6, 8 and 9 may be implemented in 
whole or in part within the programmed instructions of a 
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microprocessor. In addition, the principles of the invention apply 
to any form of MPEG or non-MPEG compatible electronic program 
guide.. , Further, the principles . of, the invention apply , to 
communication on any form of\ communication link including . via 
5 cable, infra-red, radio,, microwave, , and via a computer network. In 
addition, it is to .be, ; noted that the formation of the composite 
program guide as described herein .may be performed -at a location 
. remote from a video ^ . rece^r, and ^accessed by the receiver via; , a 
communication , nety/ork. .. , r ? , J ,. 
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CLAIMS 

1. Video decoder apparatus for 4 decoding input video 
data encoded in a plurality of encoding formats, comprising: 

5 a first processor for decoding MPEG compatible data 

identified by a first data identifier to provide a first decoded 
video output; 

a second processor for decoding data encoded in an 
Internet compatible data foriiiat'r v "'said ,;; -- Internet data being 

1 0 identified by a second - f dMa identifier to provide a -second decoded 

video ^output; arid ; - - -> ' 

a display processor for formatting said first and second 
decoded video^ outputs - for ^display ^"rciimposite video image 
erein > - ^ / 

15 ^ ' • the proportion"^ iniage contributed^ by said 

first aiid^ second l - decoded outputs is; ^arrafcle. 1 " d * : 

2. Apparatus according to claim 1, wherein 

^aid first and vsecond :L pr6cess6Vs decode data separatee! 

2 0 using said first and" second data ideritifiefs from a 'single composite 

input datastream. 

3. Apparatus according to claim 1, ; wherein 

( ^ said first processor decompresses MPEG compatible 

2 5 compressed data, * 1 

4. Apparatus according to J clairir 1 , wherein 

\ ^ * iaid ^ second processor decodes ' data formatted 

according • to* 'the ' TCP/IP' protocol; ^ ' f 

30 • _ . 

; ; 5-'? Apparatus according to J claim r 4,; Wherein ' • i 
■ said l"htemirt : dompatible -"iato'-fbnnar includes- data 
encoded in at least one of a) HTML format, b) Java™ format, and c) 
ActiveX™ format. 

35 
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6. Apparatus according to claim 1, wherein 
said proportion of said video image contributed by 
said first decoded output is variable between 0 and 100%. 

5 7 - Apparatus according to claim 1, wherein 

said display processor stores said composite ; video 
image in a pixel memory. 

< . 8 - Apparatus ^ according to claim 1, wherein. 

10 . said 4 is Pj* y ^ 

decoded outputs as separate images within said-, xomposite r video 

; image and ; _ . ^: ;; , Tr: ^ . ... , D ,, L:y:q ^J^b "J 

said Proportion ^pf^said 0 : cofn^psjte 03 wdeo .image 

contributed by said first and second decoded outputs is variable in 
15 . response to : ^t , least. ; pne pf^a) User, selection,., (b) ^formatting data : , 

received in said im^^d^o ..-data,, and, (^^p^progwmimed 

processor instruction. 

: - ^'^P^r^^^^^^S^v-^^^iBi : in ? a gj^ Representative input 
2 0 video . data , encoded in a,, plurality of encoding forma:t5, h comprising- 
the steps of: 

identifying MPEG compatible first image 
representative data; „ . . . , , 

- identifying s secpnd image representative, ..data encoded 
2 5 in an Internet compatible data format; 

decoding said first image representative data using a 
first method; , to pro vide^a^, first decoded output; ., , ., : 

decoding. , said secpnd image^ representative data using 
a second method to provide a second , decoded- putput;,. and 
30 formatting said first and second decoded outputs for 

display as .a composite , video, yimage wherein the . proportion of said 
, videp image contributed by said first and,, second; decoded outputs 
is .variable. 

•• ■ ,>■■■ .' - , .... . • .-53: . . 

•<r-. 
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10. A method according to claim 9, further including 

the step 6f: 

separating said first and second image representative 
data from a single composite input datastream. 

5 : ' ' 

11. Apparatus according to claim 9, including the step 

of " ' ' ' . - • • • ' . * 

determining whether a User is authorized to access 

said first image representative 'data* and Wherein 
10 said step of ^coding r said first" image- representative 

data occurs in response to said authorization. 

12. Apparatus according to claim 11, including the step 

of _ - , . 

1 5 - ^^ r ' : d^crypiing said L: first im#ge Representative- ' data -in- 

response to said User authorization. ,rrr^. r , . 

f ;; 13; A method^ according t6 u claim" 9, including the steps 

of . . ^ ^ ' _ " 

2 0 - ' { '" receiving program 1 guide information ihd 

" :i selecting wefr' r page information ; for di^iay- from said 
received program guide information. ^ > t : 

14. A method according to claim 9, including the step 

2 5 of 

receiving an index of web page information and 

including the step of 

selecting said second image representative data from 

said index. 

30 

15. A method according to claim 9, including the step 

of 

decompressing MPEG compatible compressed first 
image representative data to provide said first decoded output. 
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16. A method according to claim 9, including the step 
-of ... . • ..... 

decoding^ second image representative data .formatted 
5 according to the TCP/IP protocol. 

17. A method according to claim 9, including the step 

varying, . said , T proportion of c said . video , image 
1 0 contributed by said first depoded, oiitpjit. . ^ 

18. A method according to claim 9, including the step 

decoding second image representative data formatted 
1 5 |in at least ; ? one , of a) HTML f prmatv, : &) lay a™ , , fcormat, and c) 
ActiveX™ format. , A * . 

■ *»...:■.:. — _ < ^ Including the step 

• of • - - "V" ' ° ; t " : ^° ' " v " w - ^ 

20 varying sai^> c prjopojtion ri of said, video image , 

contributed : by said;, fi?st ^ c ffd^d -^Wtpul^ in response to at least 
one of (a) User selection, (b) fcppnatting; data received in s^id . input 
video data, and (c) pre-programmed processor instruction. 
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AMENDED CLAIMS 

[received by the International Bureau on 25 March 1998 (25.03.98); 
5 original claims 1-19 replaced by new claims 1-19 (5 pages)] 

• 1. Video decoder apparatus for decoding input video data 
encoded in a plurality of encoding formats, comprising: 

a first processor for decoding 1 "MPEG compatible "data 
10 identified by a first data identifier to provide a first decoded video 
output; - - 4 ^ ^ ' ( „ 

- :,;a. secorid^ processor "for decoding l ^ in an Internet 

compatible data format, said- r liTtehie^ identified by a second 

data identifier to provide a second decoded video output; and 
15 a display pPbcessbr 1 for-' fo^aMn'g f " 3 is^d''fiiSt^''and' second 

decoded video outjmtfs ^r^display 21 ^ a^'fompb'sSfef^vidw ' iffiage wherein . 

the proportion of said video image contributed by said first 
and second decoded outputs is variable and said first and second data 
identifiers are derived : - : f$dM- v p^ said 
20 Internets :: data with video - program : content 1 ^first^ 
decoded video output.^ 1 - ^acc-ciu^ - 7 ^" y ' 

:r v: 2v^ Apparatus ' : according to claim 1, wherein 
•\ . said first and ^second 'processors 1 dec6aft J "data separated 'using 
25 said first and second data : ^ identifiers : I from a -sihgle composite * "input 
datastream. 

3. Apparatus according to claim 1, wherein 

said first processor decompresses MPEG compatible 
30 compressed data, and 

said decompressed data is synchronized with second 
decoded video output using timing data in said MPEG compatible data. 

4. Apparatus according to claim 1, wherein 

35 said second decoded video output represents an index of 

web page information. 
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5. Apparatus according to claim 1, wherein 
the format . of said Internet ; compatible data ... includes data 

encoded in at least one of a) . TCP/IP format,- b) HTML format, c) Java™* 
format, and d) ActiyeXTM format. . . . .. 

6. Apparatus according to claim 1, wherein h ; 

pud Pfop^^.ot;^d t ^d^o ;t ;im^ *ep v n^i^ute;d::.b r . said first 
decoded output is . variable s b^een^ 0^ and n l;Q0^.b 2 , ^v^! K r,b thi i. ■• « 

;i r: - ^^^P^rPf^^^-^res said^omposjtte ^idsQcimage in ■<&. 
pixel memory. " . , , 

jr en * : /. :".».?oc tr>;,:ij ■i.s.jiv t>f*2 :<•;• -to'.noqo-fq . •>»..* 

£'s.h ?V :* -rvl .bis;: ;.,*d*h.*"* l- h^bv-:.t..b ?. •:«:.?.?«. 

fY. /; 8 '^^ 

j - ;Jsaid;.^jay J^es?or. r fp^ate said .first : and second decoded : 
outputs as separate images within said composite video .image andr- bct : 

said proportion of said composite video image contributed 
by said first and second decoded output^ |s. jvariafcle ,Jo ^.s-ponsij to at*. 
leaS S 0n ? :: of b (a i - s ? r ^ eI ^ t »>il?) iorinattioi data -reoeiyed ... in said input 
25 video cjata, and (c) pre-prqgr^mmed processpr^instej^tio^^r, :9 ; r 
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9. A method for decoding- image representative input video 
data encoded in a plurality of encoding formats, comprising the steps of: 
deriving first and second data identifiers from program map 
information associating Internet data with* video program content 
10 within said input video data; 

identifying MPEG compatible first image representative data 
using said c first ; data identifier; ~ — ' 

: :L. i!i : identifying second r *in£ag^ representative data encoded in an 
Internet compatible data format using said second data identifier; 
15 l ^jv , decoding ?s^d^ u imagfe represehtatiye data 

using a first MPEG data decoding method to provide a first ilecoded 
output; . * 

i idecodin*^ &ai<i» 'identified " second imkge representative data 
using ga second! Iifternef'-^datta -decoding methisd ^tb prdvicieV a second 
20 decoded output; and^n- ^ ^ — - Mi - ' ' 

formatting said first and second decoded outputs for^display 
as a composite video image wherein - the 'prdpdrtion of said /video image 



contributed by said first and second decoded ' A 'oatputs/is\.y^able/ 



10. A method according to claim 9 t further including the step 



of: 



separating c said -first ^nd' second image representative data 
from /a: single j composite input datastream. 



c ' 11. .Apparatus according to claim 9, including the ste|> of 
determining whether a User is authorized to access 'said first 
image representative data and wherein 

said step of decoding said first image representative data 
occurs in response to said authorization. 

12. Apparatus according to claim 11, including the step of 
decrypting said first image representative data in response 
to said User authorization. 
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13. A method according to claim 9, including, the steps of 
receiving prqgram guide information and 

: receiving web page information; for display, said received 
web page information, being selected from said received program guide 
0 information. 6 

14. A method according to claim 9, including the, step; of s.- 

; , ™W\?S an index , of. web, E^:^fmjitiQmr,^rmcludinir 
the step of ^ , , . ^ _„r ^ .... * M . 4 . _ , 

ndex. " 1 ... ... 



from' said index. 



_ 15, A method ^co.i;dii^.. i to. : cIai I nr^ r .i9<?lu#ng the stepv.of 
,^r' : ? C ^mW si $Z~bM?Wt- SPBPatible r compressed:: first.ima*e 
representative data to provide said first decoded output- 



_ v : ; 16^ A method ^Qrding .tq. claim.^ including the step -of r - ... 
decoding second^ image, representative, , data -formatted in a t 
least one of a) TCP/IP format, b) HTML format, c) Java™ format! and d) 
ActiveX™ format. _ ... . t ._. 

i > 1 7 r A me?h ^ a ^ c H d . in ?: : ?°. claim 9, ; including the step of 

varying said proportion .qf.said, video image "contributed b y 
said first decoded output in response to at least one of (a) User selection 
(b) formatting data received in , said input video data, and < C ) pre- 
programmed , processor .^^Q^trqc^onu . , > » 
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... 18. A method for decoding image representative input video 
data . encoded in an Internet compatible data format, comprising the 
steps of: j 

identifying first image representative data encoded in an 
10 Internet compatible data format using a first data identifier; 

j ^decoding said identified firist ..image* representative data 
using an : " Internet data decoding /5 method % to; proyide an index of web 
page informatibh^%sspciated with}; j video ^r0gfam : content in said input 
video dataf 1 . Lrl..J 

15 : t * -/ identifying second image representative data encoded in an 

Internet compatible data, fojrmat using second data identifier, said 
second image ; representative) datai- representing a web page selected 
from -said index of web £age; information;^ < j' 

■ 1 decoding said] identified^ secjoiid;: -image representative data 
20 using said Internet, data decoding ^methc|db tpjjpro^ide said selected web 
page; and ^ l ' ' ■ " !. ?: z ^ n • 6 • 

^formatting said selected web pag^ for; display. 

* ; i ; ; j s .; * ; 

19V A ; method according to claim i 18, including the step of 
25 deriving first; and second data ; identifiers from program 
map information associating said selected web page with said index of 
web page information. - 1 
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